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Abstract :  Since  its  introduction  by  Box  and  Hunter  (1957)7  rotatability  of  a 

response  surface  design  has  always  been  associated  with  single-response  models. 
The— present  article  extends  this  design  concept  to  multiresponse  models.  For 
these  models,  rotatability  means  constant  prediction  variances  and  covariances, 
and  hence  correlations,  among  the  predicted  responses  at  points  that  are 
equidistant  from  the  design  center.  It  is  shown  that  multiresponse  rotatability 
can  be  achieved  if  and  only  if  the  design  is  rotatable  (in  the  usual  sense)  for  a 
single-response  model  whose  order,  or  degree,  is  the  highest  among  all  the 

response  models  under  consideration.  This  property  does  not  depend  on  the 

\ 

form  of  the  variance-covariance  matrix  of  the  responses.  f~  .  - - 


AMS  Subject  Classification:  Primary  62K99;  Secondary  62J99. 


Key  words  and  phrases:  Design  moment;  Multiresponse  model:  Prediction 
variances  and  covariances;  Rotatable  design;  Single-response  model. 
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1.  Introduction 


Box  and  Hunter  (1957)  proposed  the  idea  of  rotatability  for  a  single-response  model  of  the 


y  =  Xf3  +  (. 


By  definition,  a  design  D  for  fitting  model  (1.1)  is  rotatable  if  the  prediction  variance,  Var[^y(£)J, 


where  y(£)  is  the  predicted  response  at  a  point  £,  remains  constant  at  all  points  that  are  equidistant 


from  the  design  center.  Equivalently,  the  quality  of  prediction,  as  measured  by  the  size  of  the 


prediction  variance,  remains  invariant  to  any  rotation  of  the  coordinate  axes,  if  the  design  is 


rotatable.  This  is  a  desirable  feature  in  a  design,  but  is  not  an  essential  one.  However,  since 


rotatability,  or  near  rotatability,  can  be  easily  achieved,  it  is  rather  insensible  to  work  with  a  design 


that  has  a  considerable  deviation  from  rotatability.  Draper  and  Guttman  (1988)  and  Khuri  (1988) 


proposed  two  different  measures  of  rotatability  to  determine  when  a  design  is  near  rotatable. 


In  a  multiresponse  situation  several  responses  are  considered  simultaneously.  Suppose  that 


we  have  a  system  of  r  response  variables;  vlt  y2,..„  yr;  each  of  which  depends  on  the  same  set  of  k 


input  variables  denoted  by  x,.  x2 .  xt  within  an  experimental  region  A.  The  input  variables  are 


coded  so  that  the  design  center  is  the  point  at  the  origin  of  the  coordinates  system.  The  model  for 


the  i —  response  is 


y,-(0  =  /*,■(*)  +  <i,  «=  1.  2,....  r. 


where  /i,(£)  is  a  polynomial  of  degree  d,  defined  at  f  =  (xit  x2 _  xt)/  and  c[  is  a  random  error 


( i  =  1.  2,...,  r).  Model  (1.2)  can  be  expressed  as 


y,(f )  =  X  i,  f  c-,  *=1.2 .  r. 


52 
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where  x'  =  (1,  £*),  is  the  derived  power  vector  of  x,  of  degree  d(,  which  consists  of  powers 


and  cross  products  of  powers  of  xlt  x2,...,  xt  with  suitable  multipliers  such  that 
x^  ^  =  (x^x)  (see  Box  and  Hunter,  1957,  Section  5),  and  /?,•  is  a  vector  of  unknown 
parameters  (i  =  1,  2,...,  r).  The  number  of  elements  of  x~  is  p-,  where 


(k  +  d,  , 

Pi  —  (  ^  |  ,  1  —  1,  2,...,  r. 


(1.4) 


If  observations  are  made  on  the  r  responses  at  n  design  settings,  then  from  (1.3)  we  obtain 
the  models 


y,  =  X;  /?,•  +  e,,  1  =  1,  2,...,  r, 


(1.5) 


where  y  •  and  e,  are  the  vectors  of  observations  and  random  errors,  respectively,  for  the  i—  response, 
and  X;  is  of  order  nxp,  and  rank  p{  (1  =  1,  2,...,  r).  It  is  assumed  that 

E(e,)  =0,  !  =  1,  2,...,  r,  (1.6) 

E(£, ■£>)  =  %•  In.  *.7=1.2 . r,  (1.7) 


where  In  is  the  identity  matrix  of  order  nxn.  The  models  in  (1.5)  can  be  displayed  as  a  single 
multiresponse  model  of  the  form 


-  A  - 


where  ym  —  (yt,  y2,...,  yr)  ,  (3m  —  (i#lt  dr)  ,  <m  —  (<lt  e2,...,  <r)  i  an^  *s  *^le  block- 

diagonal  matrix,  diag  ^X,,  X2,...,  Xrj.  By  (1.6)  and  (1.7),  the  variance-covariance  matrix  of  tm  is 
?  ®  !ni  where  E  =  (aij)  *s  the  variance-covariance  matrix  of  the  responses  of  order  rxr  and  ®  is 
the  direct,  or  Kronecker,  product  symbol.  The  best  linear  unbiased  estimator  of  0m  is 


r  y1 

=  [_^m  (?  *  ®  -n)  ^rn(?  1  ®  !n)  Jfm- 


The  variance-covariance  matrix  of  0m  is  given  by 


Var(^m)  —  X(n^E10ln^Xm 


(1.10) 


Let  ym(£)  be  the  rxl  vector  of  predicted  responses  at  a  point  £  in  the  region  A,  that  is, 


ym(p  =  [yi({).  hCO.  -i  yr(Oj. 


y,(0  =  *'  ■'  J_,  ,=  1.2. 


and  dt  is  the  best  linear  unbiased  estimator  of  d,  obtained  from  (1.9).  Formula  (1.11)  can  t hen  be 


written  as 


ytn(£)  —  ^  (O  l^iin 


/  [d,l  [d-,1  [<l r  1  \ 

ere  A ( £ )  =  diag  Lx  ,  x  ‘  .  xl  J.  From  (1.10)  and  (1.121  the  vari 


of  Vm(£)  is  equal  to 


ranance-rovariance  matrix 


I 


r  -r1 

Var[ym(0]  =  A'^X^Xr1  ®  In)  XmJ  A(£). 


(1.14) 


Definition  1.1.  A  design  D  for  fitting  the  multiresponse  model  in  (1.8)  is  said  to  be  rotatable  if 
Var  [ym(0]  *s  constant  at  all  points,  that  are  equidistant  from  the  origin. 

This  definition  is  equivalent  to  stating  that,  when  the  design  is  rotatable,  the  variances  and 

covariances  of  the  predicted  responses  are  constant  on  spheres  (hyperspheres,  in  general)  centered  at 

the  origin.  This  implies  that  the  r(r— 1  )/2  correlations  among  the  predicted  responses  are  also 

constant  on  such  spheres.  The  same  thing  can  be  said  about  the  variance  of  any  linear  combination, 
r 

Ej  c,  y ,•(£),  of  the  predicted  responses.  This  is  a  desirable  feature  since  certain  linear  combinations 
of  the  responses  may  be  of  special  interest  to  the  experimenter.  For  example,  it  may  be 
experimentally  difficult  to  obtain  independent  measurements  on  some  response.  If,  however,  this 
response  is  linearly  related  to  the  other  responses  (because  of  physical  or  chemical  laws),  then  its 
value  can  be  determined  in  terms  of  the  other  responses  (see  Box  et  al.,  1973,  Section  6). 


2.  Conditions  for  Multiresponse  Rotatability 

Let  £  and  rj  be  two  points  that  arc  the  same  distance  from  the  origin.  There  is  an 
orthogonal  matrix,  T,  of  order  kxk  such  that  >7  =  T£.  Let  z  =  (1,  r]')\  then  z  =  Rx,  where 
x  =  (1,  t')1  and 


R  =diag(l,T). 


The  matrix  R  is  orthogonal  of  order  (L-M)x(L-M).  The  derived  power  vector  of  degree  d  of  z  is  of 


the  form 


,W  .  „Kd  .M.I  . r. 


'  rr.F-~  O.  VT  V\  V .r*'  W'JW  ^  if*  »y  "J*  v 


*m(S'1  ®  In)  k  =  k,J  X'  X;) 

s'  X^E'1  ®  In)  Xm  S  =  (V;  R'  [d,]  X'  X;  R[d;1| 


where  a'’  is  the  («,ji)—  element  of  E’1.  In  order  to  achieve  multiresponse  rotatability  we  must 


therefore  have 


X{  X;  =  R'td,]  X'  X;  R[djl  i,j  =  1,  2,...,  r, 


for  every  orthogonal  matrix,  R,  of  the  form  given  in  (2.1). 

I  [d] 

Now,  let  t  be  the  vector  (1,  tlf  t2,...,  tt)  .  Its  derived  power  vector  of  degree  d,  is  t  1 

(i  =  1,  2,...,  r).  Consider  the  expression 


Qy  =  X'  X;  t[djl,  I,J  =  1,  2,...,  r. 


Note  that 


X,  ft .  (,M  ,|d'>  ?;[d-Vd'' . 


=  [(?{  i)dj.  (?2  t)^ .  (?n  t)dj]  ,  j  =  1.  2 . 


where  x[,  =  (1,  £{,)  and  is  the  vector  of  u~  design  settings  for  the  input  variables 
(u  =  1.  2 .  n).  Formula  (2.7)  can  then  be  written  as 


ft 


where  ei;  =  [jdt  +  d;)/2j  is  the  greatest  integer  in  (d-  +  dj)/2.  The  coefficient  of  t*1  l-?...  lk  in 
(2.13)  is,  therefore,  zero  if  any  of  the  6t  (/  =  1,  2,...,  k)  are  odd  integers.  If  all  the  bt  are  even,  then 
the  coefficient  is 


a^/2)! 

i=i 


k 

6  =  E 

l=i 


<5,  <  d,  +  d  ,  i.j  =  1.2. 


(2.14) 


By  comparing  (2.10)  with  (2.14)  it  can  be  concluded  that  a  design  is  rotatable  if  and  only  if  the 
design  moments  through  order  d,  +  dj  (»,;  =  1.2,....  r)  are  of  the  form 

0,  if  any  <5,  is  odd 


(l,‘2‘,...t*)  = 


>■'!  n 


/=! 


sj  2  * 

0  '  n  (*//2)! 


.  if  all  the  6 ,  are  even 


l=i 


where  A/  is  the  quantity 


- 

As  — 


at 


(b/2)l  (d,  +  d.  -  <M! 


(d,  +  d;)! 


(2.15) 


(2.16) 


Since  (2.15)  must  hold  for  all  i.j  (=  I.  2 .  r),  it  follows  that  the  moments  through  order  2d.  where 


d  =  max  (dr,),  of  a  rotatable  design  must  be  of  the  form 
l<a<r 


^',/vvx  v  ■>  v.v.v 


(l‘,2‘,...t*‘)  = 


0,  if  any  6 1  is  odd 


a,  n  («/)! 

— .  — ' ,r. -  ,  if  all  the  6,  are  even, 

2,/2  n  (s,r.  y. 

i=  i 


where  <“>  =  D  <5,  <  ‘id,  and  A,)  is  given  by 


a,  2l,/\8/2)\  (2d  -  A)! 


where  a<  is  the  value  of  a in  (2.16),  which  corresponds  to  i  -  j  =  i*  and  i*  is  such  that 

d-  =  d  =  max  (d„). 

■*  i<o<r 

On  the  basis  of  (2.17)  it  tan  finally  be  concluded  that  the  necessary  and  sufficient  condition 

to  achieve  multiresponse  rotatabilitv  is  that  the  design  be  rotatable  for  a  single-response  model  of 

order  d  =  max  (d„). 
i<o<r 


3.  Examples 

Example  1.  Consider  a  multiresponse  system  consisting  of  the  three  response  models 


Vi  —  ^io  +  1  ^ i i x i  +  '^i2x2  +  ‘^iaxa  +  '  i 


Vo  —  ' ^ “f"  iCMXj  -+-  ihjXi  +  -4- 


,  ir  ■  -  .  1 

o  j“*a.  JljT 2  j".  . 


y3  =  ^30  +  (.S  03lX,  +  E  ^3iiX,Xi  +  .E  ^3,,xi  +  (3- 


Here,  k  =  3,  r  =  3,  dj  =  d2  =  1,  d3  =  2,  hence  d  =  2.  The  variance-covariance  matrix  of  the 
responses  is  assumed  to  be 


2  1  0 

E  =  13  2 


The  models  are  fitted  using  the  design  D  given  in  Table  1.  This  is  a  second-order  rotatable  central 
composite  design  with  one  center  point.  By  (2.17),  D  is  also  rotatable  in  the  multiresponse  sense. 
Using  formula  (1.14)  it  can  be  verified  that 


Var[yj({)]  =  .1333  +  .1464  p 2 


Var[y2(0]  =  .20  +  .2197  p2 


Var[y3(§)]  =  3.4671  -  1.9285  p2  +  .5617  p 4 


Covp^p,  y2(0]  =  .0667  +  .0732  p2 


Cov^y^),  y3(0]  =  0 


Cov[y2(0,  y3(0]  =  .  1333  +  .1464  p2 


where  p2  =  x,  +  x?  +  x3.  Thus,  the  variances  and  covariances  of  the  three  predicted  responses  are 


\  ■  ir:  i 


constant  on  spheres  centered  at  the  origin. 


To  demonstrate  that  multiresponse  rotatability  does  not  depend  on  the  form  of  £.  another 


value  of  this  matrix  is  now  used,  namely, 


3  5  1 


E  =  5  9  3 


l  3  4 


Formulas  (3.2)  -  (3.7)  become 


Var^U)]  =  .20  +  .2197  p2 


Var[y2({)]  =  -00  +  .059  p2 


Var[y3(£)]  =  1.1884  -  .3819  p2  +  .1652  p4 


Cov[y,(0,  y,(0]  =  .3333  +  .3661 


Cov[y,K),  y3(0]  =  -0667  +  .0732  p2 


Cov[y2(0,  y3(0]  =  .20  +  .2197 


Example  2.  Consider  again  the  three- response  system  .as  in  Example  I.  except  that.  y2  is  now 


represented  by  the  second-order  model 


1 


8 


1 


y 2  =  020  +  .2  02, *i  +  S  /J2(jXiXj  +  £  ^2»iXi  +  €2 


The  design  D  and  the  variance-covariance  matrix  E  are  the  same  as  in  Table  1  and  formula  (3.1) 
respectively.  In  this  case,  the  variances  and  covariances  of  the  three  predicted  responses  are 


Varfy^O]  =  .1333  4-  .1464  p 


Var[y2(0]  =  2.5042  -  1.4675  p2  +  .413  pA 


Var[y3(f)]  =  4.9418  -  3.0083  p2  +  .8261  pA 


Cov[y,(0,  y2({)]  =  .0667  +  .0732  p2 


Cov[yi(0,  y3(0]  =  0 


Cov[y2(0,  y3(§)]  =  1.9767  -  1.2034  p2  +  .3304  pA . 


4.  Concluding  Remarks 

i)  In  practice,  the  variance-covariance  matrix  E  of  the  responses  is  unknown.  Hence,  the 
estimator  f3m  in  (1.9)  and  its  variance-covariance  matrix  given  in  (1.10)  cannot  be  computed. 
An  estimator  of  E  is  therefore  needed.  There  are  several  possible  estimators,  two  of  which  are 
given  below  (see  Srivastava  and  Giles.  1987,  Section  2.3) 


?  =  (%) 


?  =  (%)’ 


-  14  - 


vhere 


%  =  y'i  [in  -  X.IX'X,)'1  x']  [in  -  X,(X;'x/  X']  y;/n 


(■1.3) 


%  =  ?!  [in  -  X(X'X)‘ V] 


(4.4) 


where  X  is  the  matrix  for  a  single-response  model  of  order  d  =  max  (dr,)-  The  first  estimator 

l<a<r 


was  proposed  by  Zellner  (1962).  If  E  is  substituted  by  E  and  II  in  (1.9),  we  get  the  estimators 


-l 


^ms  —  Krn(?  *  ®  In)  XmJ  X^E  1  ®  Inj  ym 


(4.5) 


-l 


^ms  —  Xm^E  1  ©  In  j  Xm  Xm|h  1  ©  lnj  ym, 


(T6) 


respectively.  Substituting  these  estimators  for  ilm  in  (1.13)  leads  to  the  predicted  response 
vectors  yms(£)  and  yms(Oi  respectively. 


The  true  variance-covariance  matrices  of  /fms  and  jms  are.  to  order  ()(n"1). 


asymptotically  equal  to  the  variance-covariance  matrix  of  Jm,  which  is  given  in  (1.10).  See 
Srivastava  and  Giles  (1987,  Section  3.3).  Approximate  expressions  for  Var£yms(£f]  and 
Var[?ms(Oj  can  l*'011  obtained  from  (1.14)  by  substituting  E  by  E  and  E,  respectively. 
Hence,  for  large  n  these  expressions  are  almost  constant  on  spheres  centered  at  the  origin,  if  the 
design  is  rotatable. 

The  constancy  of  prediction  variances  and  covariances  on  spheres  when  the  design  is  rotatable 
results  in  constant  correlations  among  the  predicted  responses.  This  interesting  property  is 
particularly  useful  for  simultaneous  inference  making  involving  the  responses.  It  would  be 
quite  discomforting  if  such  inference  were  to  change  by  a  mere  rotation  of  the  coordinate  axes. 


which  can  occur  in  the  absence  of  multiresponse  rotatability. 
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